Inattainability of Carnot efficiency in the Brownian heat engine 
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We discuss the reversibility of Brownian heat engine. We perform asymptotic analysis of Kramers 
equation on Biittiker-Landauer system and show quantitatively that Carnot efficiency is inattainable 
even in a fully overdamping limit. The inattainability is attributed to the inevitable irreversible 
heat flow over the temperature boundary. 
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How efficiently can Brovifnian heat engine work? This 
question is important not only for the construction of 
theory of molecular motors ||l| but also for foundation 
of non-equilibrium statistical physics. Like Carnot cycle, 
Brownian heat engine can extract work from the differ- 
ence of the temperature of heat baths, where Brownian 
working material operates as a transducer of thermal en- 
ergy into mechanical work. The feature of this engine 
is: 1) It operates autonomously. 2) It is driven by fi- 
nite difference of the temperature of heat baths both of 
which contact with the working material simultaneously. 
Thus, this engine works because the system is out of equi- 
librium. Feynman devised what is called Feynman's 
ratchet that can rectify the thermal fluctuation for work 
using the difference of the temperature of two thermal 
baths. Biittiker Q and Landauer |Q proposed a sim- 
pler type of Brownian motor and pointed out that one 
could extract work even by the simple heat engine where 
a Brownian particle is subject to a spatially periodic heat 
baths in a periodic potential |^ . 

One crucial point on the Brownian engines is the ef- 
ficiency [^,|| |l7| . Feynman claimed that his thermal 
ratchet can operate reversibly, resulting in Carnot effi- 
ciency. Recently, however, some authors claimed that 
Feynman's claim was incorrect, while some author sup- 
ported it: Parrondo and Espahol discussed that Feyn- 
man's ratchet should not work reversibly since the engine 
is simultaneously in contact with heat baths at different 
temperatures Sekimoto devised so-called "stochas- 
tic energetics" and applied it into Feynman's ratchet . 
He showed numerically that the efficiency is much less 
than that of Carnot. Hondou and Takagi showed that re- 
versible operation of Feynman's ratchet is impossible us- 
ing reductio ad ahsurdum [ p^ . Magnasco and Stolovitzky 
studied how the engine generates motion with detailed 
analysis of its phase space On the other hand, Sak- 
aguchi claimed that the Feynman's ratchet could oper- 
ate reversibly by proposing a "stochastic boundary con- 
dition" Similar result is also found in r ef. II (not 



on Feynman's ratchet but on Biittiker-Landauer system), 
on which detailed discussion will be made later. These 
studies have reminded us that there is difficulty as to 
the energetic description on Brownian systems, because 
naive application of conventional energetics formulated in 
thermodynamic and/or equilibrium system into Brown- 
ian system may lead incorrect result. 

Operation of Brownian engines is done by the engines 
themselves and the engines are, therefore, out of equilib- 
rium. To clarify the non-equilibrium nature of Brownian 
heat engine and to find how we should apply energet- 
ics on it, it is important to make a quantitative analysis 
of the efficiency without adopting over-simplification, for 
analysis, that loses the function of a heat engine. Be- 
cause Feynman's ratchet is somewhat complex to make 
a rigorous analysis, it seems suitable to discuss Biittiker- 
Landauer system that is the simplest system of 
Brownian motors. Recently, Matsuo and Sasa analyzed 
the energetics of Biittiker-Landauer system by renormal- 
ization method [T5| ]. They claimed the system under 
quasi-static process approaches Carnot efficiency in over- 
damping limit [ p^ . Their analysis was based on a rigor- 
ous calculation starting from Kramers equation, and the 
result is clear except one point: They assumed that the 
momentum degree of freedom is always in equilibrium 
with heat bath because the system is overdamping [ p^ . 
This assumption is not easy for us to accept because the 
system is singular at the transition points [ pO[ where the 
temperature of the heat bath changes suddenly. We con- 
jectured that the essence of the mechanism of Brownian 
heat engine be concentrated on this singular point and 
that the nature of these non-equilibrium engines would 
emerge by the analysis. Thus we will discuss the en- 
ergetics of Biitikker-Landauer system with paying our 
attention to the transition points. The result will also 
give us an insight about how we should apply "stochastic 
energetics" to the overdamping systems with space- 
dependent temperature. 

Let us consider a one-dimensional Brownian system 
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that Biitikker and Landauer discussed, where working 
particles operate due to the broken uniformity of the 
temperature of the heat baths, [^jjij. While Biitikker 
and Landauer started their discussion from overdamp- 
ing equation of the system, we start from more basic 
standpoint of underdamped description, from which the 
overdamped equation is obtained by eliminating the mo- 
mentum variable. The probability density in phase space, 
p{p,q), obeys Kramers equation pl[|: 



dpjp, q) 
dt 



dJq dJp 



dpip, q) p dpip, q) 



dp 



7 d 
m dp 



PP{P, q) + mkBT{q) 



dpjp, q) 
dp 



dq 



(1) 



width between the transition point and a proper point 
on hot (cold) bath that satisfies the following inequality: 



kh <.lx<. L,j, (x ^ h OT c). 



(2) 



where Lh (Lc) is a width of hot (cold) bath {Lh+Lc = L), 
and Ith is a characteristic length scale of the transition 
region in which the probability density is different from 
that of thermal equilibrium. The length, Ith, is the prod- 
uct of thermal velocity, vth(,^ ksT / m) , and the veloc- 
ity relaxation time, t{— m/7): It^ ~ "I't^T. The choice 
of Ix does not alter the following result as long as the 
inequality, Eq.(||), is satisfied. Although we will discuss 
only one transition region, the asymptotic behavior does 
not differ in the other transition region. Hereafter we 
apply the normalization of the probability density p{jp, q) 
as [ESi 



where K{q) — — 7, to, Jq, and Jp are a fric- 
tion constant, mass of a particle, and probability cur- 
rent in space and that in momentum, respectively [p2[ . 
The potential U{q) satisfies, U{q) = Ur{q) + gq, where 
Ur{q + L) = Ur{q), g (> 0) is a gradient of the global 
slope (load) and L is a period. The temperature has the 
same spatial period as the potential, T{q + L) = T{q). In 
this Biittiker-Landauer system, there are two heat baths 
of which the temperature is Th (for hot bath) and Tc (for 
cold bath), respectively. Thus, there are the two tran- 
sition points in a spatial period where the thermal bath 
affecting the particle changes. Here we restrict ourselves 
to the case that = 0(1) for simplicity. The system 
is known to operate as a molecular engine |p|,^j8|Jl^ be- 
cause the particle can move against global gradient of 
the potential. The globally unidirectional motion was 
attributed to the difference of the temperatures of the 
baths, since the hot bath can activate working particle 
more than the cold bath. Suppose that two working par- 
ticle climb the potential, where one is in a hot bath and 
the other is in a cold bath. Then the working particle 
in a hot bath reaches the top of the potential hill more 
frequently than that in a cold bath, leading to the global 
motion in the present system. Thus, one can store work 
in proportion to the probability current. To make ener- 
getic analysis, we consider a "replica" particle, of which 
the energy is E = p^/2m + U{q). Here, the ensemble 
average over the replicas corresponds to thermodynamic 
limit 0. 

It was shown that the efficiency of this engine can have 
Carnot efficiency if the irreversible heat transfer at the 
transition points is physically negligible. Any Brownian 
motor is irreversible when they operate with finite prob- 
ability current. Thus, the operation in Carnot efficiency, 
if possible, must be in the "stalled state" |]l5|, where 
the probability current in space disappears, Jq{q) = 
(in an overdamped description) or J dpJq{p,q) = (in 
an underdamped description). "Quasi-static" operation 
requires this "stalled state" . Therefore, we evaluate 
whether and how the irreversible heat flows at the tran- 
sition point by solving stationary solution of Kramers 
equation at the stalled state(Eq.^. For this purpose, we 
will restrict ourselves to the special region, q e [—lh,lc\, 
around the transition point, g = 0, where lh (lc) are the 



dp / dqp{p,q) = 1. 



(3) 



Now, we will formulate the irreversible heat trans- 
fer from a heat bath to the working particle. R.h.s. 
of Kramers equation (Eq.|l]) has two parts. The first 
and the second terms are a Liouville operator on the 
probability density p{p, q) and thus preserve the en- 
ergy. The last term is what describes the energy trans- 
fer between the heat bath and the particle, of which 
the probability current in momentum space is written: 

Because the 



jtrr 
Jp 



PP{P, q) + mkBT{q)^^£^ 
probability current disappears, Jp^^ — 0, for the proba- 
bility density of equilibrium p{p, q) oc exp{— 
the energy flow through J^^^ can be sufficiently described 
only where q G [—lh, lc]- Average heat transfer from hot 
bath to the particle per unit time, reads 



dQh 
dt 



dp 





dq — J'J'' 
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dp 
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By integration by part through momentum space, p, and 
the property that p{p^ q) exponentially decreases to zero 
as p — > ±00, we obtain 



dQh 
dt 



,1 



= -2- 



P 

2m 



ksTh 



(5) 



This is the formula of the heat transfer from the hot 



bath to the particle |24|. When the system is in equilib- 



rium with the heat bath, the heat transfer (^^) dis- 
appears, because the theory of equipartition requires 
< p^ /2m >= kBT/2. This also shows that the energy 
exchange between the replica particle and the thermal 
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bath is dominant only near the thermal transition point, 
q = 0, where the average kinetic energy, /2m, deviates 
from kBT/2. 

We remark here how the energy flows around the tran- 
sition point. As we are analyzing the stalled state, the 
probability density p{p, q) is stationary. Thus, the en- 
ergy density, psiq) = J^^dpip"^ /2m + U{q))p{p,q), is 
stationary. Because there is no work in the stalled state, 
the conservation of energy requires that — Q. 

It shows that the same quantity of the heat from hot 
bath to the particle flows from the particle to the cold 
bath: (^) = -(^) ■ It should also be remarked 
that, in the stalled state, the efficiency vanishes except 
that the both sides of the last equation vanishes, because 
the work, the numerator of the efficiency, is absent here. 
Quasi-static operation is reversible only if the last equa- 
tion vanishes. Therefore the quantity (^^^) sufficiently 
characterizes the operation at the stalled state and thus 
we will analyze it in detail. Note that the following equal- 
ity is simultaneously derived Eq] , 



dQh 
dt 



dp^—p{p, q) 

Zm m 



(6) 



The formula confirms that the irreversible heat transfer is 
carried microscopically as a kinetic energy of the particle 
at a transition point. 

It is known, for example by the kinetic theory of gases 
p6[ , that there is finite heat transfer, /, in the system 
where a Brownian particle of finite mass and friction is 
crossing over the two regions with different temperature, 
even if the two thermal baths have no direct contact. It 
implies / = (^^) > 0. The authors of Ref. [|l5| assumed 
that the heat transfer should disappear in overdamping 
limit, ^ 0. However, their assumption is not evident 
a priori. To reveal the validity of the assumption we have 
to perform proper energetic analysis on Kramers equa- 
tion which includes the degree of momentum, p, instead 
of overdamped Fokkcr-Planck equation which lacks the 
degree. 

Hereafter, we will consider the asymptotic behavior of 
the heat transfer, /, in the limit of overdamping process 
(7 — > +00 and/or m — s- 0). To find out the asymptotic 
behavior, it is convenient to use reference heat transfer 
/* of unit mass and friction in an arbitrary set of units: 
/* = /(to = 1,7 = 1) By Eq.(|), the reference heat 
transfer /* reads: 
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dp 



p2 f^^rj.^ 



(7) 



where p* {p, q) is a probability density in the reference 
state: m = 1 and 7 = 1. We call a probability density 
p and heat transfer of arbitrary mass and friction in a 
proper set of units as the generic probability density and 
the generic heat transfer. Note that the following result 
is not altered if we have a different reference state. The 
choice of the values to = 1 and 7 = 1 for reference state 



is only for simplicity. In the reference state, the charac- 
teristic length of the transition region, Z^^, that the prob- 
ability density in momentum, p, is out of equilibrium is: 

To evaluate the generic heat transfer (Eq.H) in terms 
of the reference heat transfer (Eq.^ , we will find out the 
relation between the generic probability density with ar- 
bitrary mass and friction p{p, q) and the reference one 
p*{p,q). The potential term of Kramers equation, 
Eq.(|l]), is negligible when one discusses the asymptotic 
behavior of the overdamping ||2^. With stationary con- 
dition, ^ = 0, on Eq.(|l|), we obtain the simple equation 
that describes stationary flow in phase space around the 
boundary, q = 0: 



P dpjp, q) ^ j_d_ 
m dq m dp 



ppip, q) + m^ksTiq) 



dpjp, q) 

dp 



(8) 



We found here that this equation has a scaling prop- 
erty in mass and friction: The generic probability density 
p{p, q) is expressed using the probability density of the 
reference state p* (p, q) . 



p{p,q) = cp* [ —l=q 
m 
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(9) 



where the constant factor c should be determined by nor- 
mafization (Eq. |) ||. 

As q departs from the transition point, q ~ 0, fur- 
ther than the characteristic length £th, the probability 

density approaches that of equilibrium, where ph {p, q) ~ 

2 

Chexp{- ^^l^j,J (for q < -kh), and Pc{p,q) = 

2 

Ccexp{-2;^^|^} (for q > kh)- The coeflticients, Ch 
and Cc, are then required to satisfy the condition of the 
continuity of probability current. Thus, we have 



(10) 



which is consistent with the condition derived for the 
overdamping limit Q|. The remaining condition that 
determine Cx is the normalization. Note that the nor- 
malization of the probability density, p, is satisfactorily 
carried out even by neglecting the contribution from the 
transition region because the characteristic scale of the 
transition region Ith is much smaller than the width l^'. 
kh/lx ^ {x = h or c) (Eq.||). Then Ch and Cc are 
determined as: 



Ch = 



Cc = 



Th 



y/2-KmkBTh Tclh + Thlc V^vmk^TJh + TJc 

(11) 

With these solutions and Eq.(H), we obtain the relation 
between the two normalized probability densities p and 
p* M: 



p{p,<i) = -^p*i-7=,^q)- 

a/to \/m \ m 



(12) 



Note that this equation is valid even within the transition 
region. 

We can now express the heat transfer, /, in terms of 
the reference heat transfer, /*. We rewrite / as: 
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1^-22. 1^ dp f\q(^-^]p{p,q). (13) 



By change of variables such that p' = q' — -^q 



we obtain 



I = -2j dpJ^^_^dq^-~^y^V^p,—- 



This yields using Eq.(na 



This integrand is dominant only near the transition 
point, q — 0, with characteristic length Z*^. As we are 
analyzing the asymptotic behavior such that m — s- 
and/or 7 00, the inequality, (Zj^ <C)//i ^ ^Ih/^/m, 
is satisfied. Because the contribution from the inter- 
val q G [—"^lh/\/rn,—lh] to the integral is negligible in 
Eq.(p^ compared with that from q £ [— ^;i,0], the in- 
terval of this integral may sufficiently be replaced by 
q G [—lh,0]. Using Eq.(^, we obtain one of the main 
result of our paper [pO|: 



/ 



/ dp 

m 



(16) 



Because the characteristic length of the transition region 
vanishes in the overdamping limit, the scaling property 
is exact asymptotically. 

From this result, we can learn that the irreversible heat 
transfer at the transition point does not decrease when 
one takes overdamping limit, which is contrast to the 
claim in Ref. |l5): One way to take this limit is to in- 
crease the friction constant, 7: Then, the heat transfer 
does not decrease, because the heat transfer / does not 
depend on 7. The other way is to decrease the mass, m: 
Then, the heat transfer does not decrease neither, more- 
over the heat transfer increases in the power of l/^/m. 
The result justifies the intuitive estimation by Derenyi 
and Astumian ||l^. The heat flow is a result of bro- 
ken symmetry of probability density in momentum at the 
transition point, because the heat transfer disappears if 
the probability density is symmetric in phase space, as 
found by Eq.(o). Since an overdamped equation has no 
degree of freedom to describe the irreversible flow caused 
by the discontinuity of the temperature, the previous lit- 
erature reached Carnot efficiency |l^ . 

Up to now, we have discussed how heat transfer be- 
tween the two heat baths behaves in the overdamping 
process. We found that the irreversible heat transfer does 
not decrease in the process. One finds, however, that the 
possible work out of the system may also vary according 
to the overdamping limit, because the probability current 
may vary due to the change of the parameters, 7 and m. 
Thus, it is not yet obvious whether non-vanishing heat 
transfer, /, itself reveals that the system cannot attain 
Carnot efficiency in any condition including non-stalled 



state. Thus, in addition to the irreversible heat transfer 
discussed above, we will estimate work and work-induced 
heat transfer in an overdamping process. 

We will return to the original Kramers equation (Eq.^) 
for Biittikcr-Landauer system. We have analyzed this 
equation with retaining both degrees of freedom, p and q. 
However, we do not have to consider a momentum degree 
freedom when we discuss work out of the Brownian 
system, because the work is the function only of the dis- 
placement of the position. Thus, we start the evaluation 
of the work by the overdamped Fokker-Planck equation 
for the probability density P{q) of the system: 



dPjq) 

dt 



d 



ld_ 

7 dq 



dUjq) ^ d{kBT{q)) 
dq dq 



(17) 



where the periodic boundary condition is applied: 
P(0) = P(L) and ^\g=o = %\q=L- Explicit mass de- 
pendence on the displacement of the system disappears 
in the overdamping limit. In stationary state, 



dt 



0, 



the probability current, J{q), is independent of q. The 
probability current J reads 



J 



dUiq) , dikBTiq)) 



P{q)- 



The equation for P{q) reads 



d 



dUjq) ^ djkBTjq)) 
dq dq 



P{q) = 0. 



(18) 



(19) 



This equation shows that the change of the friction con- 
stant, 7, does not alter the probability density, P{q). 
Thus, with Eq. ([l8|) , the probability current, J, scales as: 
J oc 7~^. For a fixed load potential, the work per unit 
time is proportional to its probability current. Thus 
the sole operation, 7 — > 00, does not lead the system to 
Carnot efficiency, because the induced work (cx J) de- 
creases while the irreversible heat (Eq. (|l^)) does not 
decrease. 

To find out the mass dependence on the work, we 
consider the working particle obeying the Stokes' law 
with its radius r^, where the mass and the friction are 
specified by one parameter, tb'- cc tb and m (x Tb- 
Thus, we have oc J cx 7"^ oc . The irre- 
versible heat transfer that is independent of work 
is just the heat transfer, / (Eq.([l^)). Thus we have 
^^^^ oc m~^/^ oc r^^"^ . The work-induced heat trans- 
fer Qm that is proportional to the work W is propor- 
tional to the probability current J |L5[|. Thus, we obtain 



dQw 
dt 



OC J OC r 



B 



The three components determines the 



efficiency. Thus, we have 



dW 
dt 



ciTb 



Cl 



dQw 
dt 



dQ„,. 
dt 



C2rr 



Car 



-3/2 



C2 



C3 



(20) 



where ci, C2 and C3 are constants. The result tells that 
the efficiency decreases monotonically to zero when one 
takes overdamping limit — > 0. This result is not al- 
tered even if one includes another transition point in the 
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same period, because the asymptotic behavior of the two 
are the same. 

In this paper, we have analyzed the energetics of a 
Brownian motor of Biittiker-Landauer type. We showed 
quantitatively that irreversible heat transfer does not dis- 
appear even if one takes overdamping limit (7 +00 
and/or m — > 0). This result is in contrast to the claims 
by Refs. The mass dependence on the irreversible 

heat is consistent to the intuitive estimation by Ref. 

. We further analyzed the effect of non- vanishing irre- 
versible heat transfer on the efficiency and showed that, 
even in fully overdamping limit, Carnot efficiency is inat- 
tainable for the particle obeying Stokes' law. It shows 
that the maximum efficiency of the Brownian motor is 
not attained in the stalled state. The result revealed that 
the Brownian heat engine is qualitatively different from 
heat engines of which the most efficient operation is in 
quasi-static: Quasi-static process is the worst condition 
for the Brownian heat engine to work, while is the best 
for Carnot cycle. 

The location of irreversible heat transfer is the transi- 
tion region characterized by the thermal length It^. It is 
certain that the characteristic length Ith may disappear 
in the fully overdamping limit. Then, however, the ir- 
reversible effect at the transition region cannot be elim- 
inated. From the result we also learn a lesson how to 
apply energetics to overdamping systems with a space- 
dependent temperature: We should apply energetics be- 
fore taking overdamping limit. Otherwise, we might fail 
in proper evaluation of irreversible heat transfer within 
the transition region |^,|l5| , because energetic interaction 
between the heat bath and the particle is carried by the 
momentum exchange between them. When the particle 
has smaller kinetic energy than that expected by equipar- 
tition theorem, the particle receive kinetic energy from 
the heat bath in average. Thus, if we lose the degree of 
momentum as in the overdamped equation, we cannot 
describe this existing physical process properly. 

The present system cannot have maximum efficiency 
at a quasistatic condition. This means that the maxi- 
mum efficiency is achieved with finite probability current, 
which is therefore accompanied by irreversible dissipa- 
tion. Thus, the next challenging question would be, "Is 
there any principle that determines the optimal efficiency 
in Brownian heat engines?" 
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